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Abstract 

This paper reviews research on outcomes of writing programmes for students in Years 
3 to 13 in England, or grades 2 to 12 in the US. Studies had to meet rigorous standards of 
research including use of randomised or well-matched control groups, measures independent 
of the programme developers, researchers, and teachers, and adequate sample size and 
duration. Fourteen studies of 12 programmes met the standards. Twelve (86%) were 
randomised, two matched. Programmes were divided into three categories. Student 
achievement effects on writing were positive on average in all categories (Effect Size=+0.18), 
with similar outcomes for writing programmes focused on the writing process (ES=+0.17), 
those using cooperative learning (ES=+0.16) and those focusing on interactions between 


reading and writing (ES=+0.19). 


The ability to express ideas in writing is one of the most important of all skills. Good 
writing is a mark of an educated person, and perhaps for that reason it is one of the most 
important skills sought by employers and higher education institutions (Conley, 2003; 
Schmoker, 2018). Effective writing is essential in civic engagement, enabling people to state 
their views effectively in politics, social life, and business. The rapid growth in use of 
technological communication devices is increasing the need for everyone to be able to compose 
effectively for many purposes (Graham, Harris, & Santangelo, 2015). 

Yet among the “3 R’s” (reading, writing, and arithmetic), there is far less research on 
writing than on the other basics. This is especially true in the US, where teaching of writing 
has greatly diminished as accountability systems emphasising only reading and mathematics 
have pushed writing out of the curriculum in many places, decreasing interest in research on 
the topic. Despite evidence that the teaching of writing can improve outcomes in reading 
(Graham & Hebert, 2011), there is little focus on writing for its own sake. 

In England, a 2012 Department for Education research report found that “although there has 
been an improvement in pupils’ achievement in writing, it is the area where pupils perform less 
well compared to reading, mathematics and science”. The report also pointed to gaps in the 
research evidence: “There is no evidence on why pupils perform less well in writing in 
comparison to reading and the other core subjects. There is little evidence on specific 
interventions to help pupils with writing, and very little evidence on interventions for secondary 
school pupils. There is limited evidence on the predictors of pupils’ achievement in writing. 
There is very little evidence on effective strategies for teaching spelling. There is little evidence 
on pupils’ performance in writing in studies of international comparisons.” (Department for 


Education, 2012) 


Although reading and writing can be seen as two sides of the same coin, and do have 
many similarities, writing is also very distinct. A good writer must have something to say, must 
have a plan for how to put ideas into written form, and must be able to reflect and self-edit to 
be sure that a written product communicates with its desired audience. Necessary writing skills 
are very different for different purposes and genres. For example, the ability to write a 
comparison—contrast composition is very different from writing a personal narrative or 
humour, and writing a business letter requires very different skills from writing poetry. There 
are language mechanics skills, such as grammar, punctuation, usage, and spelling, that are 
important in all areas of writing, and one might argue that there are elements of persuasion and 
informational writing that underlie many more specific genres. But a proficient writer needs a 
broad range of experience and skill to take on any particular task to appeal to any particular 
audience. 

A remarkable proportion of all research and reviews of research has been carried out 
by Steven Graham and Karen Harris and their colleagues. Based on their reviews of their own 
and others’ research, especially focused on students who are struggling writers, they have 
proposed a set of consensus conclusions about what is known about effective writing strategies 
in primary and secondary schools. Their key conclusions are as follows (from Graham, Harris, 
& Santangelo, 2015): 

1. Establish writing routines that create a pleasant and motivating writing environment 


(Graham & Perin, 2007). 


To write well, students need to be excited about the opportunity to express themselves, 
not fearful about making mistakes. Effective writing teachers model their own 
enjoyment and excitement about writing, celebrate good writing by displaying it or 


putting it into class anthologies, attribute success in writing to effort rather than ability, 


encourage sharing of writing drafts among peers, and assign writing tasks appropriate 


to students’ interests and needs. 


Implement a process approach to writing (Hillocks, 1986; Sandmel & Graham, 2011). 


Writing process models give students extended opportunities to write. They usually 
include writing teams in which students help each other plan, draft, revise, edit, and 
“publish” compositions. Two examples are Self-Regulated Strategy Development 
(Graham et al., 2012) and Writing Wings (Madden et al., 2011), described in some 


detail in the “Findings” section, below. 


Create routines that ensure that students write frequently. 


Not surprisingly, students who write more write better (Graham & Perin, 2007; 
Gallagher & Kittle, 2018). Practice in writing is especially important in giving students 
opportunities to write in many genres and for many purposes and audiences. Adding 15 
minutes of writing each day can make a substantial difference in writing outcomes, and 


contributes to reading outcomes as well (Graham et al., 2015). 


Design instructional routines in which students compose together. 


Process writing programmes usually involve students working together on 
compositions. In England, the Paired Writing Programme (Yarrow & Topping, 2001) 
taught students to work with each other at each stage of the writing process. Students 


had “help sheets” for each stage of the process, asking questions such as, “is the writing 


suitable for its purpose and for the reader?” and later on, “does each sentence begin 
with a capital letter and end with a full stop?” For example, partners may help each 
other plan what each will write, give feedback on a rough draft or “sloppy copy’, 
respond to a revision, and suggest edits for spelling and punctuation, before each 
student produces a final product. In each case, the peer is able to provide helpful and 
supportive feedback, before the teacher does the same review of students’ work. As a 
practical matter, this frees teachers to spend more time on drafts that are already better, 
but there is much anecdotal evidence to the effect that students learn a great deal from 


responding to others’ drafts, gaining insight into ways to improve their own writing. 


5. Establish goals for students’ writing (Rogers & Graham, 2008). 


Setting high but realistic expectations for what students are to achieve is important in 
motivating them to do their best. Graham et al. (2015) provide two examples of high but 
attainable expectations: “add three new ideas to your paper in revising it,” and “address both 
sides of an argument, providing three or more reasons to support your point of view and 
countering at least two reasons supporting the opposing view.” 

Other basic principles advocated by Graham et al. (2015) include providing frequent 
feedback, ensuring students acquire writing skills, knowledge, and strategies, and teach 
handwriting, spelling, and typing. They support teaching sentence construction and sentence 


combining. 


Methodological Problems in Research on Writing 


While there is a great deal of research on writing, including the research that validated 
the principles emphasized by Graham et al. (2015), much of the research uses research designs 
and measures that are susceptible to substantial inflation of effect sizes. Graham et al. (2015) 
excluded studies lacking control groups and ones without quantitative, objective outcomes, but 
much writing research involves very small samples, measures closely aligned with the 
experimental programme but not fair to the control group, and very brief study durations, all 
of which have been found to greatly inflate study outcomes (Cheung & Slavin, 2016; Inns et 
al., 2018; Pellegrini et al., 2018). There are studies of writing methods that do not have these 
problems, but they are much smaller in number than are rigorous studies in reading or 


mathematics, for example. 


Purpose of This Review 


The purpose of this review is to provide meaningful, useful information on approaches 
to writing instruction that have met high standards for research, essentially the standards the 
Education Endowment Foundation applies to its own funded studies. Using these rigorous 
inclusion standards restricts the review to a modest number of studies, but the findings from 
these studies can be trusted to a greater degree than could a review that accepted many more 


studies meeting lower standards. 


Methods 
The review methods used in this review are similar to those of Baye et al. (2018), a 
review of secondary reading approaches, with appropriate revisions for the unique case of 


writing. 


Inclusion 


Studies were considered for possible inclusion according to a standard set of criteria, as 


follows. 
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1. 


Studies had to evaluate writing programmes, or programmes focused on key 
components of writing, such as grammar, punctuation, usage, and spelling. Studies of 
reading methods were also included if they had a strong emphasis on writing and used 
post-tests including writing or language arts outcomes. 

Studies had to take place in regular schools (not in special education) in Year 3-13 (or 
grades 2-12 in the US). They had to take place in industrialised countries that use an 
alphabetic writing system. 

Studies had to be reported in 1990 or later. Studies of technology applications had to 
be reported in 2000 or later, because of the rapid changes in technology over time. 
Students, classes, or schools could be assigned at random to experimental and control 
treatments, or matched based on pre-tests and demographics, as long as matching was 
done in advance. 

Studies had to include a control group also being taught comparable writing skills, but 
using different methods (usually standard teaching of writing). 

At pre-test, experimental and control groups could not differ by more than 25% of a 
standard deviation. Pretest differences in the analytic sample (after attrition) also had 
to be less than 25% of a standard deviation. 

Differential attrition (loss of students between pre-test and post-test) had to be no more 
than 15% greater in one treatment group than in the other. 

Measures created by researchers or developers, overaligned with content or procedures 
taught in the experimental group but not the control group, were not accepted. For 


example, a study of persuasive writing that used an independent measure of persuasive 


writing would be accepted if the control group was also learning persuasive writing, 
but would be rejected if the control group was not being taught persuasive writing. 
Studies find that use of measures made by researchers and aligned with the 
experimental treatment greatly inflate effect sizes (Cheung & Slavin, 2016). 

9. Writing measures scored by the students’ own teachers were rejected, as this would 
increase the potential for bias. 

10. Studies had to have a duration of at least 12 weeks. Brief studies tend to inflate effect 
sizes (Pellegrini, 2018). 

11. Studies had to have a sample size of at least 30 students and two teachers in each 


treatment. 


Statistical Procedures 
For each accepted measure, effect sizes were computed for each measure. We used a 
formula as follows: 


_ Xt = xX c 
o> SD; 


That is, post-tests adjusted for pre-tests and other covariates were compared in 
treatment and control classes or schools, and then divided by the student-level, unadjusted 
standard deviation of the control group. When the control group SD was not available, a pooled 
SD was used. We used procedures described by Lipsey & Wilson (2001) to compute ES when 
less usual statistics were presented. 

After computation of effect sizes for each measure, study means were computed, and 
then means for programmes and categories of programmes were computed, weighting by 


sample size (inverse variance). 
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Findings 

Characteristics and outcomes of studies that met the inclusion criteria are summarized 
in Tables 1-3. Most studies included measures of language mechanics and other measures 
beyond writing, but there were not enough studies of any particular outcome to analyse 
systematically, so this review focuses on creative writing, not mechanics. However, outcomes 


for other measures are described in each study description and in Tables 1 to 3. 


Writing Process Models 


Writing process approaches teach writing by engaging students in a step-by-step 
sequence of planning, drafting, revising, editing, and “publishing” (or completing) 
compositions in multiple genres. Such models make use of peers to help each other through the 
process, and emphasise teaching of meta-cognitive strategies such as graphic organisers, 
timelines, mnemonics, and self-talk. Four studies of two programmes emphasised writing 
process (see Table 1). The weighted mean effect size for writing measures in these studies was 


+0.17 (n.s.). 
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Table 1: Writing Process Models 
Self-Regulated Strategy Development (SRSD)/Improving Writing Quality/IPEELL 
Writing- 
Study Design | Duration N Grade | Sample Characteristics Posttest bier eae hes ° 
Sizes 
. ; Progress in 
23 primary Students predictedto |p, glish 
schools achieve Level 3 or an (PiE Test) 
Torgenon (11E, 12C) eet insecure Level 4 in English 
et al (2014) CR 2 terms 261 6-7 by the end of Key Stage 2 Exended Writing : 
students from primary schools in Scare +0.74* 
(142E, West Yorkshire Readi 0.09 
119C) 33%FSM, 50%EAL <AOine = 
Spelling & 0.13 
Grammar : 
a KS2 
: Schools in Leeds and Writing -0.09 
1 year 2465 2 : 
Year 6 Lancashire Reading -0.23* 
(Year 6) students : a 
20% FSM Spelling -.022 
(1243E, 4 
Torgerson Maths -0.22 
1222C) 
tals 78 schools 
(2018) KS 2 
(40E, 38C) ; 7 
Schools in Leeds and Writing +0.11 
2 years 2196 Years : : . 3 
(Vears5-6)| students 5-6 Lancashire Reading -0.17 
39% FSM Spelling -0.28* 
(1164E, Maths -0.30* 
1032C) ; 
6+1 Trait Writing Model 
Coe et al. l year | 74 schools | Grade ; ; z 
(2011) CR (2 cohorts) | (39E, 35C) 5 Schools across Oregon |Essay + 0.08 


Key for Tables 1-3: 


CQE: Cluster quasi-experimental CR: Cluster randomised; QE: Quasi-experimental; SR: Student 
randomised 

E: Experimental; C: Control 

AA: African American; A: Asian; H: Hispanic; W: White 

EAL: English as an Additional Language; ELL: English language learner 

FSM: Free school meals (UK); FRL: Free/reduced lunch (US) 

SEN: Special Education Needs (UK); SPED: Special education (US) 

CAHSEE: California High School Exit Exam; CST: California State Test; EPT: English Placement Test 
"= p<.10 

*=p<.05 


Self-Regulated Strategy Development, or SRSD, is the most extensively evaluated of 
all writing programmes in the US (Graham et al., 2012). However, most SRSD evaluations 
took place in special education settings, did not meet the sample size or duration requirements, 
lacked control groups, or otherwise did not meet inclusion standards. The approach is designed 


primarily for pupils who are poor readers and writers. They are taught strategies to plan, draft, 


edit, and revise writing products in many genres. Pupils learn specific scaffolds and self- 
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regulation strategies to help them know how to get their ideas organised and down on paper 
and then to evaluate and improve their own work. 
A UK adaptation of SRSD called Improving Writing Quality (IWQ) was evaluated in 
Years 6 and 7 in Calderdale, West Yorkshire, with funding from the Education Endowment 
Foundation (EEF). The adaptation added experiences for students to stimulate their 
imaginations for writing (although control students also received these experiences). These 
included field trips and visits to classrooms by veterans and other interesting people. Year 6 
teachers received two full days of CPD on SRSD methods, followed by ongoing consultation 
from peers. 
The main elements of SRSD lessons for each genre were as follows: 
e Discussion of the genre 
e Pre-assessment 
e Mnemonics (e.g., iPEELL: Introductory paragraph, Points, Examples/elaboration, 
End, Links, Language) 
e Graphic organisers 
e Self-scoring and graphing 
e = Self-talk 
e Peer scoring 
e Final assessment 
An evaluation by Torgerson & Torgerson (2014) focused on Year 6 students predicted 
to read at levels 3c to 4b by the end of Year 6 in 23 primary schools. The schools were randomly 
assigned to [WQ or control conditions. Treatment began after pupils took their SATs. The 
students from the primary schools were then followed into 3 secondary schools, where they 
were maintained in their conditions through the first term of Year 7, making this a two-term 


intervention. 
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Outcomes strongly favoured IWQ on the main outcome, writing scales from Progress 
in English (PiE), which focuses on persuasive and informative writing. These skills were 
emphasized in IWQ. The effect size for all students was +0.74 (p<.001), and for students 
qualifying for free school meals it was +1.60 (though this was not significant due to low sample 
size). Effects were slightly negative for grammar and spelling (ES= -0.13, n.s.), and for reading 
comprehension (ES=-0.09, n.s.). Students who were at levels 4a and above at pre-test only 
received treatment in Year 6, not Year 7, and they did not make significantly greater gains than 
controls. For these students, effect sizes for writing averaged ES=0.00 (n.s.), for grammar and 
spelling, the average was ES= +0.04 (n.s.), and for reading comprehension the average was 
ES= -0.12 (n.s.). 

A second, much larger evaluation of SRSD involved a writing process approach called 
IPEELL, for Introduction, Point, Explain, Ending, Links, and Language. Torgerson et al. 
(2018) evaluated IPEELL in 84 primary schools in Leeds and Lancashire serving 2,682 
students. In this SRSD adaptation, the trainers were teachers given IPEEL training, but were 
not SRSD experts as in the Calderdale study. Two cohorts were involved. One was schools 
randomly assigned to use IPEELL in Year 6 only, or to continue business as usual in a control 
group. The other cohort was schools randomly assigned in Year 5, which continued in their 
assigned treatment through Year 6. 

Like all writing process approaches, IPEELL involves students in a cycle of planning, 
drafting, editing, and revising compositions in various genres. As in the earlier study, students 
in IPEELL participated in “memorable experiences”, such as field trips or visits by interesting 
people, to stimulate their writing. However, in this study, control as well as experimental 
students received these experiences. 

Outcomes of the IPEELL evaluation were very different from those of the earlier 


Calderdale study. In the one-year trial (Year 6 only), the control group scored non-significantly 
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higher than the experimental group on Key Stage 2 (KS2) writing (ES=-0.09, n.s.). The two- 
year cohort (Years 5-6) found non-significant positive effects on a writing test composed of 
items from historical KS2 tests (ES=+0.11, n.s.). The average effect size across the two cohorts 
was +0.01. Outcomes for students qualifying for free school meals were very similar, averaging 
+0.04 (n.s.) across the cohorts. 

In both the one-year (Year 6) and two-year (Years 5-6) trials, measures of non-writing 
outcomes favoured the control group. This was true in reading (ES= -0.23, p<.05), spelling 
(ES= -0.22, p<.10), and maths (ES= -0.22, p<.10) for the one-year trial, and for reading (ES= 
-0.17, p<.05), spelling (ES= -0.28, p<.05), and maths (ES= -0.30, p<.05) in the two-year trial. 
These distressing findings may derive from an excessive focus on writing, leaving reading, 
spelling and maths with inadequate attention. 

One clue to the different findings in the earlier Calderdale study and the 
Leeds/Lancashire study is provided by a subanalysis of writing outcomes for high and low 
achievers. For the two-year cohort, low achievers averaged an effect size of +0.26, which was 
nearly significant (p<.10), in contrast to the high achievers (ES=+0.06, n.s.). The Calderdale 
study was limited to low achievers, so it is possible that the Leeds/Lancashire study did 
replicate the Calderdale findings with this group. However, there was no such trend for the 
one-year cohort (for low achievers, ES= -0.13; high achievers, ES= -0.02). 

The weighted mean for all students across the Calderdale study and the two cohorts of 
the Leeds/Lancashire study was +0.22 (p = .06). 

The 6+1 Trait Writing Model is built around an approach to analysis and evaluation of 
writing that emphasizes six traits: Ideas, organisation, voice, word choice, sentence fluency, 
and conventions. The “+1” is presentation (e.g., form and layout). The model is designed to 


supplement other writing approaches by providing specific criteria to assess writing. In 
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particular, it was designed to supplement writing process models by providing a focus for self, 
peer, and teacher evaluations of writing products. 

Two major U.S. studies (Coe et al., 2011; Kozlow & Bellamy, 2004) have evaluated 
the 6+1 Trait Writing Model. An Oregon study involving fifth graders (Year 6) in 74 schools 
found small but significant positive writing effects (ES=+0.08) on a holistic evaluation of 
student essays (i.e., not on the six traits themselves, which did not meet inclusion requirements 
due to being made by developers). Kozlow & Bellamy (2004) found an effect size of +0.04. 


Across the two qualifying studies, the mean effect size was +0.06 (n.s.). 


Co-operative Learning 


Co-operative learning writing programmes emphasise students working in small groups 
to help each other with writing. They resemble writing process models in using a plan-draft- 
revise-edit cycle, but place a much stronger emphasis on co-operative writing groups. Four 
studies of four programmes are summarised in Table 2. They had a weighted mean effect size 


on writing measures of +0.16 (n.s.). 
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Table 2: Co-operative Learning 
Writing- 
Study Design | Duration N Grade Sample Characteristics Posttest Lao nba he ie 
Sizes 
Writing Wings 
63 teachers 22 high-poverty schools in |Essay Style +0.17 
; (32E, 31C) urban, rural, and suburban |[deas and 
Madde et CR l year | 922 students Ores locations across 11 US Organisation +0.08 
al. (2011) 3,4 
(467E, states. Machin 012 
455C) 30% AA, 27% W, 26% H | ceramics ME 
Student Team Writing 
5 schools Language 40.38* 
(2E,3 C) ; eo Expression 
High poverty, majority AA 
Stevens 3986 Grades : : 
CQE 1 year middle schools in 
(2003) students 6-8 Bleanares Meatand Language 0.00 
(1798 E, > Marylanc- Mechanics 
2188 C) 
Collaborative Strategic Reading (CSR) 
PSs onools 16 middle schools in 
Denver 5660 
Public students |Grades Dewees Colorado: State Test: 
ue: CR | 1 year . 62% H, 19% W, 11% AA, [Pe °° +0.07* 
Schools (3101 E, 6-8 Writing 
(2016) 2559 C) 30% ELL, 11% SPED, 
76% FRL. 
3 cohorts 
Expert 21 
State Test 
iat 6 teachers 
wie (3 E,3C) 1 middle school in urban 
se &lorra| 1 year |276 students ee New Jersey. 71% H, 27% INE): “Ree 
(137 E, 139 AA, 100% FRL. 
(2012) C) Language & +0.22 
Literature 


Writing Wings is an approach to teaching writing in which pupils work in writing teams 
to help each other through writing process activities. That is, students help each other plan, 
draft, revise, edit, and “publish” compositions in various genres such as personal narrative, 
comparison/contrast, business letter, and persuasive. Teachers are given specific guides to 
teaching overall writing process and then guides for each genre. In addition, students view 
videos in which a writing team composed of humorous puppets works together to model 
writing processes. Each team member in the videos models a unique set of strengths and 
weaknesses as a writer. 

Madden et al. (2011) carried out a randomised evaluation of Writing Wings in 22 high- 
poverty schools in urban, rural, and suburban locations across 11 US states. Pupils in grades 3- 
4 (Years 4-5) were given one of two writing prompts at pre- and post-tests, and these were 
scored by raters unaware of students’ treatment assignments. Raters were given examples of 
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students’ writing indicating different ratings within each grade. Effects were positive but not 
statistically significant at the cluster level for style (ES=+0.17) and ideas and organisation 


(ES=+0.08), for a writing mean of +0.13. For mechanics, the effect size was +0.12. 


Student Team Writing is a co-operative learning programme for middle schools in which 


students work in four- or five-member teams to help one another build reading and writing skills. 
Students engage in partner reading, story retelling, story related writing, word mastery, and story- 
structure activities to prepare themselves and their teammates for individual assessments and 
compositions that form the basis for team scores. Instruction focuses on explicit teaching of 
metacognitive strategies. Stevens (2003) evaluated Student Team Writing in high-poverty middle 
schools (grades 6-8/Years 7-9) in Baltimore and found a significant positive effect size of +0.38 


(p<.05) on language expression. The effect size for language mechanics was 0.00. 


Collaborative Strategic Reading (CSR), a US programme, teaches reading 


comprehension and writing strategies to students working in small co-operative learning 
groups. During the first 4-6 weeks of the intervention, teachers model reading strategies such 
as activating prior knowledge, predicting what will be learned from an expository passage, 
identifying breakdowns in understanding, finding the main idea, and generating questions after 
reading. During the remaining 12-14 weeks, students are assigned to co-operative learning 
groups to allow them to master each strategy. The intervention is implemented 50 minutes a 
day, two days a week, during regular English Language Arts lessons. In a study in Denver 
(Denver Public Schools, 2016) with children in grades 6-8 (Years 7-9), small significant 


positive effects were found on state tests of writing (ES=+0.07, p<.05). 


Expert 21, a commercial US programme, uses a mix of teaching, co-operative work, 
and computer-assisted instruction to provide student texts and supportive materials focused on 
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building English, writing, and comprehension skills, including whole-class and small-group 
discussions, teaching of metacognitive skills such as graphic organisers, and collaborative 
projects. Sivin-Kachala & Bialo (2012) found substantial positive effects of Expert 21 on state 
tests of writing (ES=+0.58, p<.05) and positive but non-significant effects on language and 


literature (ES=+0.22). 


Programmes Integrating Reading and Writing 


Most approaches to writing focus mainly on that subject and clearly related topics such 
as grammar, punctuation, usage, and spelling, and while they may also contribute to reading 
gains (Graham & Hebert, 2011), that may not be their primary intention. Similarly, reading 
approaches may have secondary impacts on improving writing (Graham et al., 2018). However, 
there are some programmes explicitly designed to teach literacy as a unified whole, and to 
improve performance in both subjects (Graham et al., 2017). For example, such programmes 
often have students write about texts they have read, and forming arguments based on evidence 
(as suggested by current Common Core State Standards and college- and career-ready 


standards in the US). Writing effects of programmes that seek to balance and integrate reading 
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and writing are discussed in this section. Table 3 summarises six studies of five programmes 


in this category. The weighted mean effect size was +0.19 (p < .01). 


Table 3: Proeransmes Integrating Reading and Writing 


Writing- 
Effect Sizes 


Colleze-Ready Writers Program 


Analytic Writing Continuum 
44 districts 
EBC) fonts] Deere sees [sam oar | 
Gallagher et al. (2017) 2436 68% FRL, 38% Minority Structure +0.20* 
(12598, 1227C) 


| Conventions} | 02 


15 schools (9 middle, 6 high) fom a wii 
(2012) ¢ Mostly mainstreamed Latino ELLs. 


inl —— te AE 


pose |= | 
Ie: 


Academic Instruction for All Students 


- 14 urban middle schools in a large 
Less et al. (2014) 20 weeks i : urban school district, Califomia. 
: 71% ELL, mainly Spanish speaking. 


Course (ERWC 


24 schools across California 
(3309 B, 3309] SA 45% H 27% A 24% W. (PT) 
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The College-Ready Writers Program (CRWP) was created to respond to the college- and 


career-ready standards adopted by almost all US states around 2010. It places a strong emphasis 
on argument writing, using evidence to support arguments from sources, and placing less 
emphasis on grammar and punctuation. 

CRWP provides teachers with a “using sources tool” that walks them through a series 
of questions in their analysis of students’ work. These include ratings from “Skillfully 
integrates” to “Does not use source material.” Another question is, “Does the writing 
distinguish between the student’s own ideas and the source material?” Teachers receive 
professional development in which they take on roles as students and then analyse the content, 
observe models, and reflect. 

A large study of CRWP was carried out by Gallagher et al. (2017) in 44 high-poverty, 
rural districts across ten US states, over a two-year period. Students were in grades 7 to 10 
(Years 8 to 11). Districts were randomly assigned to CRWP or control conditions. Students 
were pre-and post-tested on on-demand writing prompts emphasising source-based argument 
writing. Students read four to six short texts and were asked to write an argument based on the 
texts. These were scored using the Analytic Writing Continuum (AWC), developed by the US 
National Writing Project, with adaptations to focus on argument writing. Writing products were 
scored by raters blinded to students’ assignments to conditions. Significant differences 
favouring CRWP schools were found for content (ES=+0.20, p<.05), structure (ES=+0.20, 
p<.05), and stance (ES=+0.15, p<.05). Effects on conventions (mechanics) (ES=+0.12, n.s.), 


were not significant, with a writing mean of +0.18. 


Pathway is an approach to secondary reading and writing that is primarily designed to 
help speakers of languages other than English in the US to succeed in demanding coursework. 


It provides extensive CPD to teachers, including six full days of in-service, and five after- 
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school sessions of two hours each over a full school year. Teachers provide students with a 
“tool kit” of cognitive strategies to analyse text or inform their own writing. The tool kit 
provides strategies for planning and goal setting, tapping prior knowledge by asking questions, 
constructing the gist, self-monitoring, revising, and evaluating. Teachers model elements of the 
tool kit over time, and students practise strategies in their reading and writing. 

Two studies have evaluated Pathway’s effects on writing (and reading). Kim et al. 
(2011) and Olson et al. (2012) evaluated Pathway in a large California district with a sample 
that was 95% Hispanic. Outcomes across grades 6-11 (Years 7-12) were significantly positive 
on the California Standards Test Writing scale (ES=+0.10, p<.05) and on the Assessment of 
Literacy Analysis (ES=+0.48, p<.05). A second study by Olson et al. (2017), also in a large 
California district and also with a majority-Hispanic population (68%), found positive 
outcomes on the Academic Writing Assessment (ES=+0.53, p<.05). On the broader California 
High School Exit Exam (ES=+0.22, n.s.), there were no significant differences. The mean 


effect size across the two studies was +0.30 (p < .01). 


Philosophy for Children (P4C) is a programme designed to improve students’ overall 
achievement by engaging them in philosophical dialogues on issues of interest to them. In 
England, training in Philosophy for Children is provided by an organisation called SAPERE. 
Gorard, Siddiqui, & See (2015) carried out a one-year evaluation of Philosophy for Children 
in 48 primary schools, randomly assigned to P4C or control conditions. The pupils were in 
Years 5 and 6. Outcomes were not significantly positive on Key Stage 2 writing (ES=+0.03, 


n.S.). 


Academic Language Instruction for All Students (ALIAS) is a US vocabulary intervention 


designed to be used 45 minutes a day in regular English classrooms including many speakers of 
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languages other than English. Each cycle of lessons is based on one informational text from which 
are extracted a small number of high-utility and abstract words on which students work deeply. 
The intervention includes a variety of whole-group, small-group, and independent activities, and 
gives opportunities for listening, speaking, reading, and writing with the targeted words. A 
California study mostly involving sixth-grade (Year 7) Spanish-speaking students found an effect 


size of +0.18 on written expression. 


The Expository Reading and Writing Course (ERWC) is a programme for 12" graders 
(Year 13) designed to prepare them to pass the California Early Placement Test (EPT), used in the 
California State University system to determine whether new university students must take no- 
credit remedial English courses or can go directly to credit-bearing English coursework. 

ERWC provides curriculum materials, two days of professional development for teachers, 
professional learning communities, and at least four on-site coaching sessions for each teacher. 
The emphasis of the programme is on discussion of text meaning, developing critical thinking 
skills, encouraging group discussions, developing oral language skills, and developing writing 
skills in multiple genres. ERWC replaces ordinary English classes for the 12 grade year. 

A quasi-experimental clustered evaluation of ERWC was carried out by Fong, 
Finkelstein, Jaeger, Diaz, & Broek (2015). Using propensity matching, students in ERWC were 
matched on prior achievement and demographic variables with similar students in ordinary 
English classes. There were a total of 56 ERWC and 58 non-ERWC teachers in 24 high schools 
throughout California. On English Placement Test (EPT) post-tests at the end of the school 
year, ERWC students scored modestly higher (ES=+0.13). This difference was significant 


(Fong & Finkelstein, 2016). 
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Discussion 

All categories of programmes that met the inclusion criteria in this review found 
positive mean outcomes for students on measures of writing (as opposed to language mechanics 
or reading). Across all 14 studies, the weighted mean writing effect size was +0.18 (p < .01). 

The three categories had nearly identical outcomes: Writing Process Models 
(ES=+0.17), Co-operative Learning (ES=+0.16), and Programmes Integrating Reading and 
Writing (ES=+0.16) all found similar positive outcomes, on average. 

Although we divided the studies into categories, many features extended across 
category lines. For example, both writing process and co-operative learning methods 
emphasised students working in partnerships, helping each other plan, draft, revise, and edit 
compositions in various genres. Although writing process programmes typically use peer 
editing, co-operative learning programmes place a strong emphasis on co-operation at all stages 
of the writing process. 

Outcomes for the three categories are not internally consistent. Among the category we 
termed writing process models, only one study found markedly positive outcomes (Torgerson 
et al., 2014), while a second, much larger study (Torgerson et al., 2018) found near-zero effects, 
on average. Among co-operative learning approaches, Expert 21 and Student Team Writing 
reported particularly positive outcomes. Among programmes integrating reading and writing, 
Pathway, ALIAS, College Ready Writer’s Program, and the Expository Reading and Writing 
Course (ERWC) had notably positive outcomes. Positive outcomes were equally likely to be 
seen in upper primary, early secondary, and upper secondary year levels. 

Overall, some of the key characteristics of programmes that produced good writing 
outcomes were as follows: 


e Use of co-operative learning 
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e Structured approaches that give students step-by-step guides to writing in various 
genres, focused squarely on writing outcomes 

e Programmes that teach students to assess their own and others’ drafts, to give students 
more feedback and insight into effective writing strategies 

e Programmes that balance writing with reading 

e Programmes that attempt to build students’ motivation to write and enjoy self- 
expression 

e Programmes that teach writing conventions (e.g., grammar, punctuation, usage) 
explicitly, but in the context of creative writing 

e Programmes that provide extensive CPD to teachers, in which they themselves 
experience the writing strategies they will employ 

In many cases, successful writing approaches will be exciting, social and noisy, but 
they should always be intentionally structured to build students’ skills, confidence, and 
motivation. Motivation is particularly important. If students love to write, because their peers 
as well as their teachers are eager to see what they have to say, then they will write with energy 
and pleasure. Perhaps more than any other subject, writing demands a supportive environment, 
in which students want to become better writers because they love the opportunity to express 
themselves, and to interact in writing with valued peers and teachers. 

It is important to note that there is a need for much more rigorous research on replicable 
writing approaches, and for development and evaluation of new approaches. It is striking to 
note that a companion review of research on secondary reading programmes using nearly 
identical inclusion criteria found 69 rigorous studies of 51 programmes, in contrast to this 
writing review, which found only 14 studies of 12 programmes. In addition to more research 
on writing, much more is needed on topics such as grammar, punctuation, and usage, as well 


as spelling. More research focusing on specific writing genres, such as personal narrative, 
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persuasive writing, and comparison-contrast, is much needed, as is writing in science, history, 
and other content areas. The handful of studies reviewed in this paper show very promising 
results, indicating that a variety of writing approaches can show well in the most rigorous 


research. But much more is clearly needed. 
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